Information Discriminant Analysis: Feature Extraction with an Information-Theoretic Objective
نویسندگان
چکیده
منابع مشابه
A Methodology for Information Theoretic Feature Extraction
We discuss an unsupervised feature extraction method which is driven by an information theoretic based criterion: mutual information. While information theoretic signal processing has been examined by many authors the method presented here is more closely related to the approaches of Linsker (1988,1990). Bell and Sejnowski (1995), and Viola et a1 (1996). The method we discuss differs from previ...
متن کاملSequential Feature Extraction Using Information-Theoretic Learning
A classification system typically includes both a feature extractor and a classifier. The two components can be trained either sequentially or simultaneously. The former option has an implementation advantage since the extractor is trained independently of the classifier, but it is hindered by the suboptimality of feature selection. Simultaneous training has the advantage of minimizing classifi...
متن کاملLinear discriminant feature extraction using weighted classification confusion information
Linear discriminant analysis (LDA) can be viewed as a twostage procedure geometrically. The first stage conducts an orthogonal and whitening transformation of the variables. The second stage involves a principal component analysis (PCA) on the transformed class means, which is intended to maximize the class separability along the principal axes. In this paper, we demonstrate that the second sta...
متن کاملAn Information-theoretic Sar Heterogeneity Feature
In this work, a heterogeneity feature, calculable from SAR images on a per-pixel basis, but relying on global image statistics, is described and discussed. Starting from the multiplicative speckle and texture models relating the amount of texture and speckle to the local mean and variance at every pixel, such a feature is rigorously derived from Shannon’s information theory as the conditional i...
متن کاملA Nonparametric Methodology for Information Theoretic Feature Extraction
We present a new information theoretic approach for training a system in a self-organized or supervised manner. Information theoretic signal processing looks beyond the second order statistical characterization inherent in the linear systems approach. The information theoretic framework probes the probability space of the data under analysis. This technique has wide application and represents a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence
سال: 2007
ISSN: 0162-8828,2160-9292
DOI: 10.1109/tpami.2007.1156